Evaluation Framework Research Articles

Navigating AACSB accreditation with strategic leadership and change management: a systematic literature review

Purpose This study aims to identify the strategic leadership and change management used to obtain the Association to Advance Collegiate Schools of Business (AACSB) accreditations as well as the research development on AACSB in the past decade. Design/methodology/approach This study used a systematic literature review following Petticrew and Roberts’ study. The articles were limited to empirical studies published from 2013 to 2022, taken from the Dimensions AI database. Findings The findings suggested that two leadership styles were used to obtain AACSB accreditation: dominance-oriented transformational and financial leadership, alongside three traits of academic leaders: commitment, engagement and encouragement. Additionally, three change management models/processes were found in the articles: teaching evaluation framework, temporary isomorphism and authenticity. Finally, they discovered that the object of the studies on AACSB accreditation had been narrowed down from the organizational level to smaller objects consisting of schools’ identity, teaching, learning and business schools’ key players. Research limitations/implications As this study only used Dimensions AI, potential articles related to the topic outside the database could not be obtained. Thus, it limits the scope of the findings of this paper. Practical implications This study informs academic leaders in business schools about the role of strategic leadership and change management in obtaining AACSB accreditation. Originality/value Through a systematic scoping review, this study presented a decade of research development on AACSB in addition to the strategic leadership and change management needed to obtain it.

Improving the undergraduate Science experience through an evidence-based framework for design, implementation and evaluation of flipped learning

Flipped Learning (FL) is a student-centred pedagogical approach where new content is introduced prior to class which permits more time during class for active learning. Despite the growing body of evidence of the effectiveness of FL, many educators are reluctant to adopt this approach to teaching or are unsure of how to implement FL in their classes. Many students are uncertain of how to adapt their approaches to learning to a FL curriculum. In response to these challenges and calls for a robust framework to guide the design and implementation of FL, we developed the Flipped Teacher and Flipped Learner (FTFL) Framework based on the pedagogical literature. This paper reports on the use of our FTFL framework in the redesign of a large first year science subject from a traditional delivery to a FL delivery. We evaluated the efficacy of the redesign using a mixed methods approach with data on students’ interactions with FL activities, and student and educator experiences. Findings from two iterations of the redesign indicate successful implementation of FL through high student engagement with online and class materials, and positive feedback from students and academics. Using the FTFL framework to guide the design and integration of FL, with an emphasis on clear communication, is key to our successful FL intervention and support of student learning.

Women's perspectives on mHealth behavior change interventions for the management of overweight, obesity, or gestational diabetes: A qualitative meta-synthesis.

mHealth interventions play an increasingly important role in health behavior change for gestational diabetes or peripartum obesity management. This qualitative systematic review and meta-synthesis aims to explore women's perceptions of mHealth behavior change interventions for gestational diabetes and/or overweight/obesity management during pregnancy and the postpartum period. Cumulative Index of Nursing and Allied Health Literature (CINAHL), Cochrane, Excerpta Medica Database (EMBASE), Medical Literature Analysis and Retrieval System Online (MEDLINE), and Psychological Information Database (PsycINFO) databases were searched using a Sample, Phenomenon of Interest, Design, Evaluation and Research type (SPIDER) concept framework through to February 2024. Included studies were quality assessed using the Critical Appraisal Skills Programme checklist. Study findings were evaluated using reflexive thematic analysis and GRADE-Confidence in the Evidence from Reviews of Qualitative Research (CERQual) checklist. We identified 29 studies, representing 604 women's views from one upper middle-income and nine high-income countries. Two themes were generated: mHealth as a supportive tool; and mHealth as a personalizable tool. Women highlighted the importance of self-monitoring, information trustworthiness, peer support, motivational tools (goal setting, risk awareness, and problem solving) and convenience in achieving behavior change using mHealth technology. They suggest mHealth programs incorporate these elements to support user engagement and improved health outcomes. Understanding what women want as mHealth users is particularly important for effective interventions in gestational diabetes, weight management, and chronic disease prevention. Creating a better, more woman-centered experience by addressing central engagement issues should result in improved maternal health outcomes.

Scenario-Based Green Infrastructure Installations for Building Urban Stormwater Resilience—A Case Study of Fengxi New City, China

Global climate change has precipitated a surge in urban flooding challenges, prompting the imperative role of green infrastructure (GI) as the linchpin of sponge city construction to enhance urban sustainability and resilience. But the evaluation of urban stormwater resilience faces challenges due to the lack of a comprehensive evaluation framework taking the intrinsic features of the resilience system into account and the insufficient coverage of alternative scenarios’ performance under multiple rainfall return periods. This study, focusing on Fengxi New City, China, evaluates the suitability of GI (i.e., green roofs, rain gardens, and permeable pavements) and constructs a stormwater management model (SWMM) for urban stormwater hydrological simulation. This study also establishes a comprehensive urban stormwater resilience evaluation system and uses quantitative methods to unify the performances of scenarios under different rainfall return periods. Our analytical findings elucidate that the suitability of GI is predominantly concentrated in the northern and western areas of the study area, with the smallest suitable area observed for permeable pavements. Divergent GIs exhibit disparate performances, with rain gardens emerging as particularly efficacious. Importantly, the combination of multiple GIs yields a synergistic enhancement in resilience, underscoring the strategic advantage of adopting a diverse and integrated approach to GI implementation. This study facilitates a deeper understanding of urban stormwater resilience and assists in informed planning decisions for GI and sponge cities.

An extraction and novelty evaluation framework for technology knowledge elements of patents

An extraction and novelty evaluation framework for technology knowledge elements of patents

The development and structural validity testing of the Person-centred Practice Inventory-Care (PCPI-C).

Person-centred healthcare focuses on placing the beliefs and values of service users at the centre of decision-making and creating the context for practitioners to do this effectively. Measuring the outcomes arising from person-centred practices is complex and challenging and often adopts multiple perspectives and approaches. Few measurement frameworks are grounded in an explicit person-centred theoretical framework. In the study reported in this paper, the aim was to develop a valid and reliable instrument to measure the experience of person-centred care by service users (patients)-The Person-centred Practice Inventory-Care (PCPI-C). Based on the 'person-centred processes' construct of an established Person-centred Practice Framework (PCPF), a service user instrument was developed to complement existing instruments informed by the same theoretical framework-the PCPF. An exploratory sequential mixed methods design was used to construct and test the instrument, working with international partners and service users in Scotland, Northern Ireland, Australia and Austria. A three-phase approach was adopted to the development and testing of the PCPI-C: Phase 1 -Item Selection: following an iterative process a list of 20 items were agreed upon by the research team for use in phase 2 of the project; Phase 2 -Instrument Development and Refinement: Development of the PCPI-C was undertaken through two stages. Stage 1 involved three sequential rounds of data collection using focus groups in Scotland, Australia and Northern Ireland; Stage 2 involved distributing the instrument to members of a global community of practice for person-centred practice for review and feedback, as well as refinement and translation through one: one interviews in Austria. Phase 3: Testing Structural Validity of the PCPI-C: A sample of 452 participants participated in this phase of the study. Service users participating in existing cancer research in the UK, Malta, Poland and Portugal, as well as care homes research in Austria completed the draft PCPI-C. Data were collected over a 14month period (January 2021-March 2022). Descriptive and measures of dispersion statistics were generated for all items to help inform subsequent analysis. Confirmatory factor analysis was conducted using maximum likelihood robust extraction testing of the 5-factor model of the PCPI-C. The testing of the PCPI-C resulted in a final 18 item instrument. The results demonstrate that the PCPI-C is a psychometrically sound instrument, supporting a five-factor model that examines the service user's perspective of what constitutes person-centred care. This new instrument is generic in nature and so can be used to evaluate how person-centredness is perceived by service users in different healthcare contexts and at different levels of an organisation. Thus, it brings a service user perspective to an organisation-wide evaluation framework.

Incidence and predictors of postoperative complications in Sub-Saharan Africa: a systematic review and meta-analysis

BackgroundPostoperative complications remain a significant challenge, especially in settings where healthcare access and infrastructure disparities exacerbate. This systematic review and meta-analysis aimed to determine the pooled incidence and risk factors of postoperative complications among patients undergoing essential surgery in Sub-Saharan Africa (SSA).MethodPubMed/MEDLINE, EMBASE, CINAHL, Web of Science, and Google Scholar were searched from January 2010 to November 2022 for completed studies reporting the incidence and risk factors associated with postoperative complications among patients undergoing essential surgery in SSA. Severity of postoperative complications was ranked based on the Clavien-Dindo classification system, while risk factors were classified into three groups based on the Donabedian structure-process-outcome quality evaluation framework. Studies quality was appraised using the JBI Meta-Analysis of Statistics Assessment and Review Instrument (JBI-MAStARI), and data were analyzed using Comprehensive Meta-Analysis (CMA) software. The study protocol adhered to the PRISMA guidelines and was registered in PROSPERO (CRD42023414342).ResultsThe meta-analysis included 19 studies (10 cohort and 9 cross-sectional) comprising a total of 24,136 patients. The pooled incidence of postoperative complications in SSA was 20.2% (95% CI: 18.7%–21.8%), with a substantial heterogeneity of incidence observed. The incidence varied from 14.6% to 27.5% based on the Clavien-Dindo classification. The random-effects model indicated significant heterogeneity among the studies (Q = 54.202, I = 66.791%, p < 0.001). Contributing factors to postoperative complications were: structure-related factors, which included the availability and accessibility of resources, as well as the quality of both the surgical facility and the hospital.; process-related factors, which encompassed surgical skills, adherence to protocols, evidence-based practices, and the quality of postoperative care; and patient outcome-related factors such as age, comorbidities, alcohol use, and overall patient health status.ConclusionThe meta-analysis reveals a high frequency of postoperative complications in SSA, with noticeable discrepancies among the studies. The analysis highlights a range of factors, encompassing structural, procedural, and patient outcome-related aspects, that contribute to these complications. The findings underscore the necessity for targeted interventions aimed at reducing complications and improving the overall quality of surgical care in the region.Systematic Reviews Registrationhttps://www.crd.york.ac.uk/PROSPERO/, identifier (CRD42023414342).

Research on Multi-Stage Post-Occupancy Evaluation Framework of Community Comprehensive Elderly Care Service Facilities under the Public-Private Partnership Mode—A Case Study of China

The key to whether elderly individuals in the community can enjoy their later years peacefully lies in the service capabilities of community comprehensive elderly care service facilities (CCECSF) under the Public-Private Partnership (PPP) mode. To maintain a high level of service capability in community comprehensive elderly care service facilities under PPP mode, scientific evaluation of the effectiveness of these facilities is equally crucial. This article first constructs a post-occupancy evaluation index system of community comprehensive elderly care service facilities under PPP mode that includes three evaluation attributes and fifteen evaluation criteria based on the Chinese culture and lifestyle habits. Regarding the issue of direct users being unable to directly participate in evaluations, the uncertainty in evaluation information, and the volatility of evaluation results, a multi-stage post-occupancy evaluation model is constructed based on probabilistic linguistic term set, TOPSIS model and multi-stage decision theory. The above post-occupancy evaluation index system and evaluation model together constitute a multi-stage post-occupancy evaluation framework for community comprehensive elderly care service facilities under PPP mode. The outcomes of the case study indicate that the post-occupancy evaluation index system can offer a scientifically guided approach for evaluating the service level of community comprehensive elderly care service facilities under the PPP mode; meanwhile, the multi-stage evaluation model can enable direct user participation in the post-evaluation of facility usage and improve the robustness and reduce the fluctuation of the evaluation results, so as to improve the scientificity of the evaluation results.

Assessing the EU Climate and Energy Policy Priorities for Transport and Mobility through the Analysis of User-Generated Social Media Content Based on Text-Mining Techniques

For over three decades, the European Union’s (EU) transport policy has aimed at fostering environmental sustainability and energy efficiency. Since 2015, European policymakers have focused more on three key sustainable development goals: decarbonizing the transport system, promoting low-emission mobility solutions, and transitioning to renewable and alternative fuels. To effectively communicate priorities and engage stakeholders, EU policymakers regularly use social media platforms like Twitter (now known as X). This active discourse involves policymakers, industrial stakeholders, the media, and the public, offering insights into the role of transport policy in addressing climate change and energy transition challenges. The current research endeavors to track and analyze the evolution of user-generated content related to climate change, energy transition, and smart mobility on Twitter from 2011 to 2021. This research uses text-mining and social network analysis techniques to quantitatively and qualitatively assess the dynamics of relevant EU policies and their effects. The study’s findings can be used to establish a robust monitoring and evaluation framework at the EU and national levels. This framework will assess the effectiveness of communicating strategic priorities for sustainable transport development. It also holds potential for application in other sectors, broadening its impact.

Mapping the Landscape of Continuing Professional Development: A Pilot Gap Map of Systematic Reviews

Gap maps graphically represent evidence from systematic reviews. We developed and tested a pilot gap map of systematic reviews examining the impact of continuing professional development (CPD). We conducted a mapping review and charted the content of systematic reviews in a pilot gap map. Directive content analysis helped develop categories in three dimensions: evaluation framework, study characteristics, and number of systematic reviews. Of 389 identified records, 29 systematic reviews were included in the pilot map. We found gaps in evidence evaluating the impact of e-learning and skills training programs on various outcomes (patient, care, and work environment). Most evaluations corresponded to Kirkpatrick's learning model, with few considering other outcomes or how CPD could be mediated or influenced by contextual factors. Rooted in social epidemiological principles, the pilot map framework introduced new ways of understanding evidence from systematic reviews. Although the pilot map illuminated several evidence gaps and perspectives important to future CPD, a complete map is needed to validate the findings.

Towards an evaluation framework for inclusive technological innovation in social and health care services

With the COVID-19 pandemic came an influx of digital technologies introduced into the care home sector. Many care homes were not ready for digital changes, and subsequently, the inclusivity of these innovations was variable. We develop a holistic evaluation framework to assess the inclusivity of service innovations, including the well-being of care home residents and employees. We adopt a mixed methods approach using the ‘non-adoption, abandonment, and challenges to scale-up, spread, and sustainability − complexity assessment toolkit’ (NASSS-CAT) to evaluate the introduction of tablet computers into care homes across Scotland and assess the inclusivity of the innovation. The paper offers a theoretical synthesis by indicating how the seven dimensions of the NASSS-CAT can evaluate the six stages of the ladder of inclusive innovation. Results specify how the care home sector could be more inclusive of its residents and staff by co-creating innovation, developing staff training, and supporting the well-being/activities coordinators.

Analyzing Hydrogen Flow Behavior Based on Deep Learning Sensor Selection Optimization Framework

Abstract With tremendous potential to lower the carbon footprint of power generation and as an alternative energy carrier for many applications, hydrogen has emerged as a key potential energy carrier. Understanding of geological conditions and the injection and production changes over time for hydrogen storage are paramount, requiring in situ reservoir sensing options. Determining the flow behavior is of critical importance in order to estimate hydrogen volumes within the reservoir. A novel AI-driven methodology for hydrogen flow behavior and volume estimation was demonstrated. For determining the S1 through S3 predicted hydrogen storage quantities, the framework is linked to an uncertainty estimate framework. The Pohokura field in New Zealand served as the basis for the framework's evaluation, and it performed acceptably in terms of identifying the hydrogen flow behaviors and quantities inside the subsurface reservoir. The framework is a significant first step in assessing the amount of hydrogen that can be stored in subterranean reservoirs for long-term hydrogen storage.

New statistical framework for interlaboratory evaluation of anti-doping testing results by WADA

AbstractThe World Anti-doping Agency (WADA) International Standard for Laboratories (ISL), developed as part of the World Anti-Doping Program, requires satisfactory laboratory performance in the WADA External Quality Assessment Scheme (EQAS) in order to obtain and maintain WADA accreditation. Under this mandate, WADA regularly distributes urine and blood test samples to anti-doping laboratories to continuously monitor their proficiency. Over the years, WADA has employed classical, generic statistical methods, in accordance to ISO 13528, to evaluate quantitative EQAS results. Here, we set out the rationale for a modern statistical approach that recognizes and addresses the particular features of the measurement results typically obtained in such tests and present an approach involving Bayesian measurement models and statistical data analysis that is tailored specifically to anti-doping testing.

Enabling organizations to strategically manage risks in circular supply chains

AbstractCircular supply chains (CSCs) prioritize resource efficiency by reusing, remanufacturing, and recycling materials, offering environmental benefits and competitive advantages. However, they are facing various risks and organizational challenges that hinder their efficiency. To ensure long‐term sustainability, this study identifies the key risks and introduces a prioritization model for risk management in CSC strategies proposing a framework for the risk evaluation based on the set of criteria and prioritization model using a combination of three multicriteria decision‐making (MCDM) methods. The model applies fuzzy Delphi‐based analytical hierarchy process (AHP) method to determine the criteria weights and fuzzy axial distance‐based aggregated measurement (ADAM) method for ranking the alternatives. The findings of this study allow for the identification of the most important risks associated with CSC enabling stakeholders to allocate resources strategically and focus efforts on crucial areas. Results highlight that the most important risks are supply chain complexity, resource availability, and quality and technological challenges. The most important contributions are the identification of the most relevant risks that threaten the resilience and sustainability of CSCs, the establishment of the framework for their evaluation, and the development of a novel hybrid MCDM model for their ranking. These contributions are also the main theoretical implications of the study. On a practical level, it enables organizations to strategically manage risks, standardize risk assessment, and improve their competitive advantage by enhancing resilience, reducing disruptions, and lowering operational costs.

Effectiveness of mindfulness-based interventions on the well-being of healthcare workers: a systematic review and meta-analysis

BackgroundGrowing evidence attests to the efficacy of mindfulness-based interventions (MBIs), but their effectiveness for healthcare workers remains uncertain.AimsTo evaluate the evidence for MBIs in improving healthcare workers’ psychological well-being.MethodsA systematic...

Quality Text Book Assessment System

The Quality Textbook Assessment System (QTAS) is a sophisticated methodology aimed at rigorously evaluating the quality and appropriateness of textbooks utilized within educational contexts. With the proliferation of educational materials and the pivotal role textbooks play in shaping students' learning experiences, there arises a critical need for a systematic approach to assess their efficacy and alignment with educational standards. QTAS addresses this need by providing educators, curriculum developers, and policymakers with a structured framework for textbook evaluation. The primary objectives of QTAS are multifaceted. Firstly, it seeks to ensure the accuracy and reliability of information presented in textbooks across various subjects and grade levels. Through meticulous fact- checking and content validation processes, QTAS identifies and rectifies inaccuracies, misconceptions, and biases that may compromise the integrity of educational materials. Additionally, QTAS evaluates the clarity and coherence of textbook content, assessing its ability to facilitate comprehension and knowledge retention among students. Moreover, QTAS places a strong emphasis on the alignment of textbooks with established educational standards and learning objectives. By scrutinizing the curriculum relevance and instructional coherence of textbooks, QTAS helps educators select materials that seamlessly integrate with existing teaching practices and educational frameworks. Furthermore, QTAS evaluates the inclusivity and diversity of textbook content, ensuring representation and recognition of diverse perspectives, cultures, and identities. Incorporating both qualitative and quantitative assessment methods, QTAS employs a combination of expert reviews, stakeholder feedback, and statistical analyses to evaluate textbooks comprehensively. This holistic approach enables QTAS to generate nuanced insights into the strengths and weaknesses of educational materials, guiding informed decision-making regarding textbook adoption, adaptation, or supplementation..

Comparative efficacy and acceptability of different exercise patterns for reducing cardiovascular events in pre-diabetes: protocol for a systematic review and network meta-analysis of randomised controlled trials

IntroductionExercise has been used to reverse dysglycaemic states in patients with pre-diabetes. Systematic reviews show that exercise is an effective way to reduce the incidence of diabetes, but there is...

Enhancing core–periphery robustness of networks against link-based attacks with imprecise information

Core-Periphery structure, as a critical mesoscale structure, is commonly found in diverse real-world networks, in which nodes are endogenously categorized as core or peripheral nodes by the underlying interconnection patterns. It plays an important role in sustaining the intrinsic order and functional behavior of networked systems. However, despite the study on inherent core–periphery vulnerabilities to node removals, little is known on the core–periphery robustness when networks are suffering from the attacks that happen on links between nodes, especially for the more practical situations where attackers have limited ability to obtain precise network information. In this paper, a novel index is proposed for measuring the capacity of the core–periphery structure to resist link-based attacks. By introducing an attack precision parameter, we establish a unified evaluation framework for link-based attacks with imprecise information, which divides attack behaviors into localized attacks and non-localized attacks, and treats the usual random attacks and targeted attacks as the two special situations of our non-localized case. Several enhancing algorithms guided by our index with local search strategy are exquisitely devised, and experimental results are provided to demonstrate the efficacy of our framework and algorithms that remarkably improve the core–periphery robustness against link-based attacks with imprecise information.

Internal trade and environmental policy effectiveness in developing countries: A binary endogenous growth model with regional Heterogeneity

The shift of environmental pollution from developed to developing countries is largely induced by global labor and trade trends. Unlike their developed counterparts, developing countries face more pronounced regional disparities in social development within the realm of environmental governance. This paper proposes a binary endogenous model to assess the implications of environmental policies on such developing nations with sizable regional disparities. The model enhances the precision in simulating real-world ramifications of environmental policy implementation. It reveals that the 'pollution haven' effect extends beyond just the relocation of pollutant-generating industries to less developed regions; it also leads to the shipment of products fabricated using environmentally-degrading processes from less developed to developed regions, thereby undermining environmental regulation. Furthermore, the model's results were juxtaposed with China's increasingly stringent national environmental protection policy, adopted since 2000. The study confirms that environmental degradation has a substantial spatial spillover effect positively correlated with internal trade volume. The paper's conclusions assist in offering a new evaluative framework for the ensuing examination of environmental policy practicality in developing countries. It also recommends policy-making tools for enhancing the effectiveness of environmental regulations in these regions, such as limiting internal trade of polluting products alongside environmental levies and subsidies.

Enhancing EV Charging Station Reliability and RAS Safety

The surge in electric vehicle (EV) adoption prompts companies to prioritize dependable charging station designs, despite hurdles in maintaining consistency. A newly proposed design, featuring 36 ports, employs both uniform and non-uniform arrangements, subjected to rigorous testing with systems ranging from 50 to 350 kW. Failure rates are projected through meticulous assessments based on MILHDBK217F and MILHBK-338B standards, employing binomial distribution and cost analysis to gauge port reliability and overall station success rates. This innovative design not only bolsters voltage stability but also curtails maintenance expenses by bolstering port reliability.In the realm of robotics and autonomous systems (RAS), Deep Reinforcement Learning (DRL) demonstrates exceptional prowess but grapples with the risk of unsafe policies, potentially resulting in perilous decisions. To address this concern, a novel study introduces a reliability evaluation framework tailored for DRL-driven systems, leveraging formal neural network analysis. This framework adopts a two-tiered verification strategy: firstly, by assessing safety locally using reachability tools, and secondly, by aggregating local safety metrics across various tasks to evaluate global safety. Empirical validation validates the efficacy of this framework in fortifying the safety of RAS.